Goto

Collaborating Authors

 session data


Replicating the behaviour of electric vehicle drivers using an agent-based reinforcement learning model

Feng, Zixin, Zhao, Qunshan, Heppenstall, Alison

arXiv.org Artificial Intelligence

Despite the rapid expansion of electric vehicle (EV) charging networks, questions remain about their efficiency in meeting the growing needs of EV drivers. Previous simulation-based approaches, which rely on static behavioural rules, have struggled to capture the adaptive behaviours of human drivers. Although reinforcement learning has been introduced in EV simulation studies, its application has primarily focused on optimising fleet operations rather than modelling private drivers who make independent charging decisions. Additionally, long-distance travel remains a primary concern for EV drivers. However, existing simulation studies rarely explore charging behaviour over large geographical scales. To address these gaps, we propose a multi-stage reinforcement learning framework that simulates EV charging demand across large geographical areas. We validate the model against real-world data, and identify the training stage that most closely reflects actual driver behaviour, which captures both the adaptive behaviours and bounded rationality of private drivers. Based on the simulation results, we also identify critical 'charging deserts' where EV drivers consistently have low state of charge. Our findings also highlight recent policy shifts toward expanding rapid charging hubs along motorway corridors and city boundaries to meet the demand from long-distance trips.


ConvSDG: Session Data Generation for Conversational Search

Mo, Fengran, Yi, Bole, Mao, Kelong, Qu, Chen, Huang, Kaiyu, Nie, Jian-Yun

arXiv.org Artificial Intelligence

Conversational search provides a more convenient interface for users to search by allowing multi-turn interaction with the search engine. However, the effectiveness of the conversational dense retrieval methods is limited by the scarcity of training data required for their fine-tuning. Thus, generating more training conversational sessions with relevant labels could potentially improve search performance. Based on the promising capabilities of large language models (LLMs) on text generation, we propose ConvSDG, a simple yet effective framework to explore the feasibility of boosting conversational search by using LLM for session data generation. Within this framework, we design dialogue/session-level and query-level data generation with unsupervised and semi-supervised learning, according to the availability of relevance judgments. The generated data are used to fine-tune the conversational dense retriever. Extensive experiments on four widely used datasets demonstrate the effectiveness and broad applicability of our ConvSDG framework compared with several strong baselines.


The Metaverse: Survey, Trends, Novel Pipeline Ecosystem & Future Directions

Sami, Hani, Hammoud, Ahmad, Arafeh, Mouhamad, Wazzeh, Mohamad, Arisdakessian, Sarhad, Chahoud, Mario, Wehbi, Osama, Ajaj, Mohamad, Mourad, Azzam, Otrok, Hadi, Wahab, Omar Abdel, Mizouni, Rabeb, Bentahar, Jamal, Talhi, Chamseddine, Dziong, Zbigniew, Damiani, Ernesto, Guizani, Mohsen

arXiv.org Artificial Intelligence

The Metaverse offers a second world beyond reality, where boundaries are non-existent, and possibilities are endless through engagement and immersive experiences using the virtual reality (VR) technology. Many disciplines can benefit from the advancement of the Metaverse when accurately developed, including the fields of technology, gaming, education, art, and culture. Nevertheless, developing the Metaverse environment to its full potential is an ambiguous task that needs proper guidance and directions. Existing surveys on the Metaverse focus only on a specific aspect and discipline of the Metaverse and lack a holistic view of the entire process. To this end, a more holistic, multi-disciplinary, in-depth, and academic and industry-oriented review is required to provide a thorough study of the Metaverse development pipeline. To address these issues, we present in this survey a novel multi-layered pipeline ecosystem composed of (1) the Metaverse computing, networking, communications and hardware infrastructure, (2) environment digitization, and (3) user interactions. For every layer, we discuss the components that detail the steps of its development. Also, for each of these components, we examine the impact of a set of enabling technologies and empowering domains (e.g., Artificial Intelligence, Security & Privacy, Blockchain, Business, Ethics, and Social) on its advancement. In addition, we explain the importance of these technologies to support decentralization, interoperability, user experiences, interactions, and monetization. Our presented study highlights the existing challenges for each component, followed by research directions and potential solutions. To the best of our knowledge, this survey is the most comprehensive and allows users, scholars, and entrepreneurs to get an in-depth understanding of the Metaverse ecosystem to find their opportunities and potentials for contribution.


Objectron (3D Object Detection)

#artificialintelligence

MediaPipe Objectron is a mobile real-time 3D object detection solution for everyday objects. It detects objects in 2D images, and estimates their poses through a machine learning (ML) model, trained on a newly created 3D dataset. Object detection is an extensively studied computer vision problem, but most of the research has focused on 2D object prediction. While 2D prediction only provides 2D bounding boxes, by extending prediction to 3D, one can capture an object's size, position and orientation in the world, leading to a variety of applications in robotics, self-driving vehicles, image retrieval, and augmented reality. Although 2D object detection is relatively mature and has been widely used in the industry, 3D object detection from 2D imagery is a challenging problem, due to the lack of data and diversity of appearances and shapes of objects within a category.


EEG-based Drowsiness Estimation for Driving Safety using Deep Q-Learning

Ming, Yurui, Wu, Dongrui, Wang, Yu-Kai, Shi, Yuhui, Lin, Chin-Teng

arXiv.org Machine Learning

Fatigue is the most vital factor of road fatalities and one manifestation of fatigue during driving is drowsiness . In this paper, we propose using deep Q - learning to analyze an electroencephalogram (EEG) dataset captured during a simulated endurance drivi ng test . By measur ing the correlation between drowsiness and driving performance, t h is experiment represents an important brain - computer interface (BCI) paradigm especially from an application perspective. We adapt the terminologies in the driving test to fit the reinforcement learning framework, thus formulate the drowsiness estimation problem as an optimization of a Q - learning task . B y referring to the latest deep Q - Learning technologies and attending to the characteristics of EEG data, we tailor a deep Q - network for action proposition that can indirectly estimate drowsiness . Our results show that the trained model can trace the variations of mind state in a satisfactory way against the testing EEG data, which demonstrates the feasibility and practicab ilit y of this new computation paradigm . We also show that our method outperforms the supervised learning counterpart and is superior for real applications. To the best of our knowledge, we are the first to introduce the deep reinforcement learning method to th is BCI scenario, and our method can be potentially generalized to other BCI cases . Fatigue is regarded as the most severe factor causing road fatalities [1] . To understand the correlation between fatigue and driving performance, both from theory to practice, is of persistent interest for researchers.


Create a questionnaire bot with Amazon Lex and Amazon Alexa Amazon Web Services

#artificialintelligence

In the Create a Question and Answer Bot with Amazon Lex and Amazon Alexa blog post, we showed you how you could create a QnABot (pronounced "Q and A Bot") for a situation in which your users have questions and you have answers. Now, what if this situation were reversed? What if you could ask users questions using quizzes, polls, surveys, and tests? These are valuable ways to drive user engagement and collect actionable feedback. Our most recent QnABot update includes the new Questionnaire Bot feature, which allows content designers to rapidly create quizzes for users and integrate them with existing QnABot content.